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Abstract 

In this paper we derive explicit formulas of the Renyi information, Shannon 
entropy and Song measure for the invariant density of one dimensional ergodic 
diffusion processes. In particular, the diffusion models considered include the hy- 
perbolic, the generalized inverse Gaussian, the Pearson, the exponential familiy 
and a new class of skew-t diffusions. 
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1 Introduction 

For a continuous random variable X with density / the Renyi information of order a 
(Renyi 1959, 1961) is defined as 

ft Q (/) = — !— log [ f a (x)dx (1.1) 



1 -a 
for a > 0, a ^ 1 and 

Ki(f):= limK a (f) = - f f(x) log f(x)dx = -Elogf(X) (1.2) 

also known as Shannon or Kullback-Leibler entropy. Renyi information is taken as a 
typical measure of complexity in the areas of physics, information theory and engi- 
neering to describe dynamical or chaotic systems (see e.g Kurths et ai, 1995). Renyi 
information, seen as a generalization of the Shannon entropy, is used to "obtain differ- 
ent averaging of probabilities" via the parameter a (see e.g. Song, 2001). Considered 
as a function of a, lZ a is also called the spectrum of the Renyi information and looking 
at its graphical plot is usually of interest. For some particular values of a, it is used for 
specific tasks in different applications. For example, Renyi information of order a = 2 
is used as a measure of diversity in economics Hart (1975) and it is also the negative log 
of the well known limiting constant appearing in asymptotic efficiency lower bounds, 
i.e. J f 2 (x)dx. Other applications to pattern recognition analysis (Vajda, 1968 and 
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Ben Bassat, 1978), extreme value theory (see e.g. Falk et al, 1994) and exponential 
models (Vajda and van der Meulen, 1998) have also appeared. Recently Song (2001) 
put in evidence that not only the spectrum of the Renyi information is useful but also 
its gradient lZ a = -§^R>a- In particular, its value at a = 1 takes the following form 

7M/) = -ivar(log/(X)) 

which means that the gradient of the spectrum evaluated at a = 1 is just the negative 
half of the variance of the loglikelihood whilst the IZi is its negative expected value. 
Song proposed the following index 

5(/) = -2fti(/) (1.3) 

as an intrinsic measure of the shape of the density /. Notice that the information lZ a (/) 
is a measure of the dispersion of / around its mean. The Song measure S is also a loca- 
tion and scale free functional in the sense that if g(x) and f(x) = g((x — ii)/&)/a then 
S(j) = S(g) and hence S it is a good measure of the shape of a distribution according 
to Bickel and Lehman (1975). When / has the fourth moment (14, the Song measure 
provides similar information to the well known kurtosis measure 02 = Ak/c 4 but S 
measures more than what 02 measures and it can be calculated also for distributions 
without /14 (e.g. Student's t with less than 4 degrees of freedom) or even without mean 
(e.g. the Cauchy distribution) and it is meaningful also for non symmetric distribu- 
tions. Further, also in cases when two distribution have the same index 02, the Song 
index may be different, e.g. the Student's t with 6 degrees of freedom and the Laplace 
distribution have both 02 = 6 but the Song measure is 1 for the Laplace distribution. 
It is approximatively 0.791 for the t distribution. This indicates that their tails are not 
heavier in the same way. Then as proposed in Song (2001) the measure S(f) can be 
used to get a partial ordering respect to the tails of the distribution, i.e. given / and g 
two densities functions, the notation / -< g means that S(f) ^ S(g). 

Liese and Vajda (1987) considered the following Renyi divergence between to den- 
sities / and g 

1 r / f(x)\ a 

D a{f,g) = —r, rlog / — ^ g(x)dx, a^0,a^l, 

a(l-a) J \g{x)J 

which can be used in hypotheses testing problems. The case Di(f,g) is the usual 
Kullback-Leiber divergence. Suppose that f(x, 9) and g(x, 9) are two members of the 
same parametric family, 9 E <d, and define the statistics T° = 2D a (f(6 n ), g(9o)) 
where 9 n is a consistent estimator of 9 and 9q the value of 9 under the null hypothesis, 
then T" can be used as test statistics and is just the usual likelihood ratio test 
statistics. Although a general theory is not yet available, several papers shows that for 
values of a > 1 the test statistics T" has often higher power than the corresponding 
likelihood ratio test statistics (see e.g. Rivas et al., 2005, Morales et al, 1997, 2000, 
2001). Further, power divergences, as defined in Cressie and Read (1984), can be 
obtained from the Renyi divergence via the Box-Cox transformation 

e a(l- a )D a _ 1 

a(l — a) 

While likelihood inference for diffusion processes has now an extensive set of results 
for both continuous and discrete time observations, very few is known about the Renyi 
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information and its related quantities for diffusion process. In particular, for contin- 
uos time observations from the diffusion process solution to the stochastic differential 
equation 




ajXf'dt + ptdWt, Xo~iV( Mi ,a 2 ), j = l,2, 



with Wt a standard Wiener process and cij real constants, Vajda (1990) has obtained 
the explicit form of the Renyi divergence of the likelihood for all a > 0. In the discrete 
case Morales et al. (2005) obtained the explicit form of T" for the model 



where a,j and bj are real constants. To the best of our knowledge, besides these two 
very simple cases, no other results are known for diffusion processes. In this work we 
consider homogeneous one dimensional diffusion processes solutions to the general 
stochastic differential equation 



with some initial condition Xq = xq and state space (I, r), with — oo < I < r < +oo. 

In this paper we concentrate on the derivation of explicit formulas for the infor- 
mation measures lZ a (f ), IZi(f) and S(f), where / is the invariant density of several 
classes of ergodic diffusion processes including Pearson, hyperbolic, generalized in- 
verse Gaussian, skew t and exponential models. The laws considered are not included 
in other papers on Renyi informations for one dimensional densities like Song (2001), 
Zografos and Nadarajah (2003, 2005) which yet cover a large variety of densities. At 
the same time, the densities considered here have been recently used to describe as- 
sets in financial markets because they describe well heavy tailed distributed returns 
(see e.g. Eberlein and Keller, 1995, Bibby and S0rensen, 2001, Boyarchenko and Lev- 
endoroskii,2002). In the light of the above considerations, we think that the Renyi 
informations obtained here could be useful for researchers with particular attention to 
the financial applications to build new diagnostic tools. 

2 General considerations 

We introduce some basic assumptions on a diffusion process defined by ( 11.41 ). 

Assumption 1. The drift and diffusion coefficient are such that the stochastic differen- 
tial equation ( 11.41 ) admits a unique weak solution X t . 

Let us introduce the scale function and speed measure, defined respectively as 



dX t = a,jdt + bjdWt, X a = x , j = 1,2, 



dX t = b(X t )dt + a(X t )dWt 



i ■ 



(1.4) 




(2.1) 



with x any value in the state space (I, r), and 



m(x) 



1 




(2.2) 
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Assumption 2. Let (/, r), with —oo<l<r< +00 be the state space of the diffusion 
process X t solution to ( 11.4b and assume that 



m(x)dx < 00 . 

Let, x* be an arbitrary point in the state space of X such that either 

s(x)dx = / s(x)dx = 00 . 



If one or both of the above integrals are finite, the corresponding boundary is assumed 
to be instantaneously reflecting. 

If the Assumption[T]|2]are satisfied, then exists a unique ergodic process X t solution 
for the stochastic differential equation (II. 4\ . with invariant law 



= (2-3) 

where G = J m(x)dx. 

Remark 2.1. The Renyi information defined by ( 11.11 ) for the invariant density function 
( 12.31 l is equal to 

km) = ^ {-"W + cxp { 2a f W • (2 - 4) 

We observe that limc,—^ TZ a (/) = logG anrf lim Q ^o T^a(f) — l°g(j)- Being the 
Renyi information a psuedoconcave and monotonically decreasing function respect to 
a (see Bector and Bhatia, 1986), then we can conclude that mf a> olZ a (f) = logG 
and swp a>0 lZ a (f) = log(j). In other words the codomain of the function (12.4b is 
(logG,log(f)]. 

Remark 2.2. The Shannon entropy for the distribution ( 12.3b becomes 

Ki(J) = -E log 

= logG - E(\oga 2 (X t )) - E(logs(X t )), 

and for b(x) — ca 2 (x), c € R, we have that 

TZxif) = logG - E(loga 2 (X t )) + 2cE(X t - X). 

We point out that it is not always easy to calculate Shannon entropy directly as 
expected value of the logarithmic transformation of the density f(x). So in this paper 
to obtain the esplicit form of 1Z\(f), we often use de l'Hopital rule. Similar consider- 
ations can be done for the Song measure defined by ( fT31 l. 

Furthermore we will denote by ip the digamma function, i.e. ijj(x) = r'(a;)/r(a;) 
and its derivative by ip(x) = -^^(x), while B(a,b) = ^ffff is the Beta function. 
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3 Pearson diffusions 



A Pearson diffusion (see Forman and Sorensen, 2006) is a stationary solution to a 
stochastic differential equation with mean reverting linear drift and squared diffusion 
coefficient of the form 

dX t = -6(X t -n)dt + <r(X t )dWt (3.1) 

= -6{X t - fx)dt + ^29{aXf + bX t + c)dW t 

where 8 > and the parameters a, b, and c are such that the square root in ( 13. Il l is well 
defined. The scale function and the speed measure of X t are respectively 

s(x) = cxp ( / — tt — dy | , mix) = — , . . — ~ ; r 

\Jx ay 2 + by + c y ) ' w 26»s(x)(ax 2 + 6x + c) 

with a fixed point such that axp + bxo + c > 0. Let (Z, r) be the state space of the 
process such that ax 2 + bx + c > for all x E (I, r). A unique ergodic solution to 
( 13. Il l with initial value xo G (7, r) exists if and only if the Assumption|2]holds. When 
the stationary process X t satisfying the stochastic differential equation ( 13.11 ) exists, 
it is called Pearson diffusion because its invariant distribution belongs to the Pearson 
system. In fact we have that 

dm(x) (2a+l)x — u + b . . 

— = o — ; m \ x ) 

dx ax z + bx + c 

We consider six particular cases as in Forman and Sorensen (2006) for (13. U which 
permit us to classify the ergodic Pearson diffusions by means of the squared diffusion 
coefficient. 

3.1 The Ornstein-Uhlenbeck diffusion: a(X t ) = V29 

For all /i G K exists a unique solution of the equation ( 13. Q . This process is known 
as the Ornstein-Uhlenbeck diffusion and its invariant law / is a gaussian density with 
mean fi and variance 1 . For a > 0, in this case the Renyi information, the Shannon 
entropy and the Song measure are respectively 

KM) = \ {log(27r)-^|, ftx(/) = i{l + log(27r)}, 5(/) = l. 

According to Remark [2~Tl we note that in this case the Renyi information has codomain 

(ilog(27r),oo]. 



3.2 The Cox-Ingersoll-Ross diffusion: a(X t ) = ^/26X t 

We obtain the Cox-Ingersoll-Ross process and the equation (13. U has a unique ergodic 
solution on (0, oo) if and only if \i > 1. The invariant distribution is a Gamma distri- 
bution with scale parameter 1 and shape parameter /i. Therefore for a > (see Song, 
2001) 

K a = —— {-cdogrO) - (a(fj, - 1) + 1) logo + \ogT(a(n - 1) + 1)} , 

1 — Q 

fti = iogr(/i)-Oi-i)V(M) + M, 

S = i>(p)(p-lf - fx + 2. 
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3.3 Pearson diffusion with a(X t ) = y/29a(Xf + 1) 



For all a > and pL € M the stochastic differential equation ( 13.11 ) admits a unique 
ergodic solution. It's easy to verify that the scale function and speed measure are 
respectively 

s(x) = (1 + x 2 )^ exp | — — arctanx | 



and 



, . i , 2\-— — i r a* l 

mix) = — (1 + x ) 2a exp < — arctanx > , 
20 la) 

while the invariant density assumes the following form 

(1 + x 2 )~ A" 1 exp arctanx} 

= r+oo,, ' 9S _ T7 I T - ^- (3-2) 
J_ (l + ar) 2a 1 exp | ^ arctana; j dx 

If /i 7^ the invariant law is skewed with tails decaying at the same rate as the t- 
distribution with 1 + 1/ a degrees of freedom whilst for /i = it is a scaled Student's t- 
distribution. This distribution is known as Pearson's type IV distribution, but a suitable 
name is the skew i-distribution with mean value //. The Renyi information assumes the 
following form 

H a (f) = —^—<-a\og[ (1 + x 2 )~^~ 1 exp (-arctanx") dx (3.3) 
1 - a y J_ 00 \a J 

+ J (1 + x 2 )~^~ a exp (a— arctanx^dx | 

a log / (cosx)~ exp ( — x ) dx 
J-n/2 v a ' 



1 



1 - a 



log (cosx) 2Q (* +1 )- 2 exp (^x) dxj 

1 I i f 7 \ ^ ( A* \ A 
a log / (cosxj a exp I x I dx 



1-a 



-it/2 



log J*'" (cosx) 2Q (* +1 )- 2 exp (-^s) dx 



r-f/2 

-7T/2 

Remark 3.1. We observe that 

(cosx) 2 (* +1 )- 2 cxp(-^x) dx 
-tt/2 \ a / 

and 

lim 7£ Q (/) = log7r 

Although the Renyi information (13.3l l cannot be written in closed form, we are able 
to calculate it explicitly for some particular values of the parameter a and of the order 
a. We start with the next result. 
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Theorem 3.1. Fixed a > 0, for a = 2a , ( "l +1) or a = 2a( I"t 3/2) , with m = 1, 2, . . . , 
we obtain that 

n mi) (f) = 2 a(m + ) } log f' 2 (cobs)* cxp (-^x) dx (3.4) 

, l + 2a / ... ({m+l)n 

■ log C (m, /z) sinh 1 



1 - 2am V V 1 + 2a 



where C(m,u) = ,, , — ... . a 2 ^ 2 "- )! , r- ant/ 

+22)...((H ? i+i)i i )V(2 m )2)' 

^ a(2m + 3) , r /2 , s i / u \ , ,„ „ 

^ 2a (m+ 3/2) (/) = — — - — -log/ (cosa;)» exp I x) dx (3.5) 

i+2a a(2m +1) — 1 J-tt/2 V a / 



1 + 20 ■ log ^(m,,) cosh r (2w + 3) ^- 



l-a(2m+l) b V v V 2 ( 1 + 2a ) 



where Dim, a) = , 2 2(2m.+i)! 

v >w ((fi^ii)^^) ... (( (a^+|)ii)% (2ra+ i)2) 
Proof. For a = ^tt^ , the espression J3.3b gives 



K wi) (/) 



2a(m+l) r /2 



2am 



— log / (cosx) » exp ( — — a; ) dx (3.6) 
1 V a / 



l + 2a r /2 , , 2m / 2(77i +1) M \ 

log / (cos xY m exp ^ dx 



1 — 2am 

By means of the formula 3.893(8) in Gradstheyn and Ryzhik (2007) 

r 7r/2 



/ (cos x) 2m exp (-px)dx 
Jo 



(2™)! j e -W2 + 1 , P 2 , pV + 2 2 ) 



p(p2 + 2 2) . . . (p2 + (2m) 2 ) 1 2! 4! 

p 2 (p 2 +2 2 )---(p 2 + (2m-2) 2 ) | 
+ 2m! J 

we derive 



J* (cosx) 2m exp (- 2( ^ + + 2 1 a )M ^) dx (3.7) 

= r /2 (cosx) 2m cxp f- gi!^±l^ ^ dx (3.8) 
Jo V l + 2a / 



f' 2 , ^2m /2(m+l)/U 

+ / (cosx) 2m exp -\ tt^-x dx 



1 + 2a 

,„ ,, f (»ti + 1) M (m+l)^ i 

(2m)! | -e r+3^ w + e W | 



2(m+l)/j [ / 2(m+l)/j 
l+2a 



^)^2 2 )...(( 2 ^) 2 + (2m) 2 
(2m)!2sinh(^ 7 r 



2(m+l)M f ( 2(m+l)M X 2 
l+2a 



2 2 



^) +(2-) 2 
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Plugging in ( 13.71 ) inside the espression (13.6b the first part of the proof is concluded. 
Analogously for a = 2a ^"^^ 2 - ) , we can show ( 13.51 ). In fact 

a(2m + 3) , f n/2 . ,i / it \ , 

7^ 2a( m+ 3/2) (/) = — — -log / (cosx)»exp --a; dx 

i+2a o(2m + 1) — 1 J-tt/2 \ a J 

1 + 2a log r /2 (cos^expf-^ + 3 ^d, 



l-o(2m+l) J-k/2 \ l + 2a 

By means of the formula 3.893(10) in Gradstheyn and Ryzhik (2007) 



/ (cos x) 2m+1 exp (-px)da: 
Jo 

(2m + 1)! 

~ (p 2 + l)(p 2 + 3 2 )---(p 2 + (2m+l) 2 ) 



| e -W2 



I ^ 2 + l , (p 2 + l)(p 2 + 3 2 )...(p 2 + (2m-l) 2 ) 



3! (2m +1)! 



we have that 

r-Tr/2 



f (cos^expf-^ + ^U 

(2m+l)!(e 2 ( 1 + 2 »' + e 2 < 1 + 2 ») J 

_ ((^) 2 + l 2 )---((^) 2 + (2- + l) : 
(2m+ l)!2coshf- 



(2m+3)u 
2(l+2o) " 



(^) 2 + l 2 )-((^) 2 + (2-+l) ; 



and ( 13.5b follows. 



The previous theorem permits us to derive the next result. 
Theorem 3.2. Let a = 1, we have that 

2m + 2 , / 2 , //i7T\ 



1 - 2m ° V V 3 
where C(m, a) = , ,, — , .,„ , ,, . 2 2 ^ 2t "- >! . 2 ^ ami 

2m + 3 , / 2 / fj,ir\ 



2m 

((^ i ^) 2 + i2).:.((<2ii i ^) i i) 2 +(2m+1) 2-) 



where D(m,/i) — 2(2m+i). 



□ 



^(/) = — log ^ cosh ^jj (3.9) 
■ 3 lo g (c(rn,,) S ^(^±^, 



K^(f) = —tog^—ooah^jj (3.10) 
— - 3 — log ( D(m, pt) cosh ( ( m + 3 ^ 7r 



Proof. The quantities ( 13 ,9b and ( B.lOt from Theorem l3.1l bv setting a = 1 and noting 
that 



/ cosxexp (— ux) dx = -coshl — I. (3.11) 

J-n/2 ^ ' 1 + ^2 V 2 J 



r ir/2 

T/2 

□ 

Theorem 3.3. For a = 1, f/je Shannon entropy is 



fcitt) = 3| C ° 1 S ^J ) - |logr'(2) - ^7rtanh(|7r) + r(2) M 2 > (3.12) 



Proof. To calculate the Shannon entropy we consider the Renyi information ( 13.101 ) and 

JL = 3 a 

da 2 (?m 



observe that a — > 1 if and only if m — > 0. Furthermore the relationship — 



holds. Then 



TZ^f) = lim^^+3(/) 
m— >0 3 



9 f 2 f 7 ^ 2 

lim — < loa' / cosxexp (— ux) dx 

>-° 4} 3 *J_„ /2 

{/^ 2 /2 (cosx) 2m+1 cxp (- (2m + 3) ^ x) dx} 

/^(cosx) 2 "^ 1 exp (- ( 2m + 3 ^ z) 



d 
c)n i 



It's not hard to show that 



r 9 
km — 

m->0 <jm 



(2m + l)!2cosh( (2m + 3) ^ 7r) 



h (2rn+^ 2 + . . (( 2 + (2m + 1)2 ^ 

4T'(2) cosh (f tt) + f r(2)/i7r sinh (f tt) - 2T(2) cosh (f tt) |^ 2 

and by using again the result ( 13.111 ). after some calculations we derive the expression 
d3~T2l . 

□ 



3.4 Pearson diffusion with a{X t ) = V 29aX t 

If a > and \i > 0, we have an unique ergodic solution to the J3.lt . In other words we 
obtain a diffusion process with invariant law 



^^TTTT(-) 2+ " exp {--}< 

fJ.T(l + -) \ax/ I ax ) 

that is an inverse Gamma distribution with shape 1 + - and scale parameter ^. For all 
values of a such that a (2 + ^) — 1 > 0, it is not hard to prove that (see also Nadarajah 
and Zografos, 2003) 
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1 17 (. W \. . r(a(2 + i) -1] 



TZ a (f) = log ( - ) + — N 1- I 2 + - ) a ] loga + log 



a/ 1-a I V all T a (l + - 

^ 1 (/) = iogf^+io g rfi + iVfi + -Vf2 + -Wi + : 



a/ \ ayy a J \ a J \ a 

^>-( 3+ ^) + ( 2 + ;) 2 *( 1 + ; 

3.5 Pearson diffusion with a(X t ) = ^/26aX t (X t + 1) 

// / \ / \ "I" 1 1 M i 

If a > 0, ^ ^ 1 we have that m(x) = (1 + x) s - 1 and the invariant density 

is a scaled ^-distribution with =^ and - + 2 degrees of freedom and scale parameter 
, i.e. 



l+a' 



/(*) 



\ a ' a / 



Hence 



^a(/)=^— (-alo g sf^,l + - 
1 — a ^ \ a a 

+ logB^a(^-l) + l,a^2 + ^ 
\a a J \a I Va/ 



S(f) 



2 + - ) V f 1 + - ) + f - + - + 1 ) ip ( - + - + 1 

ay \ a/ \ a a / \ a a 

+ (2a + l) 2 + (a - M ) 2 ^ (£) - (a + M + l) 2 ^ (2±£±i) 



3.6 Jacobi diffusion: a(X t ) = ^29aX t (X t - 1) 

If a < 0, and for all // > such that min(^, 1 — /i) ^ —a exists an ergodic diffusion 
process on (0, 1) which satisfies the stochastic differential equation ( 13. Q with speed 
measure m (x) = (1 — x) <• _1 a; _ <» _1 . The invariant law f(x) is a Beta distribution 
with shape parameters — ^, — — £i . This diffusion is also known as Jacobi diffusion. 
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Renyi information measures become 

n a (f) =-^—{-a\ogB f 



1 - a \ a a 





-0 









1 -u 

— - + 1 

a 

^(/)=log5U,-i^)+P + l)^p 
\ a a J \a J \ a 

a J \ a J \ aj \ a 



4 Generalized inverse Gaussian diffusions 

We introduce (as in S0rensen, 1997) the following stochastic differential equation 

dX t = (PiX^- 1 - foX? + foX^-^&t + XX^dWt, X = x > 0. (4.1) 
We assume that 7 ^ 0, A > and set @i = 2/?i/A 2 , i = 1,2, 3. The scale function is 

s(x) = C(x )x~ 91 exp {6 2 x + O^x' 1 } 
while the speed measure becomes 

Tfi(x) = -L-x 6 ^ exp {-6 2 x - 03X- 1 }. 
C(x ) 

If the parameters satisfy the following conditions 

01>1,02>O,0 3 >O 
1 -27 < 61 < 1,02 > O,0 3 > 

e l < 1 - 27, 2 > 0, e 3 > 



the stochastic differential equation ( 14.11 ) admits a unique ergodic weak solution (see 
S0rensen, 1997) with invariant distribution 

^-KI) a=jra ^ gp{ Xm' )} - <4 ' 2) 

The law ( 14.2b is a generalized inverse Gaussian density, where A'„ is the Bessel function 
of the third order wih index v which has the following integral representation 
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Theorem 4.1. The Renyi information for a generalized inverse Gaussian diffusion is 



The Shannon entropy is equal to 
K x = 



1 - a 



log- 



K, 



(0i-2 7 ) + l 



A< 



-2 7 + 



!(2v«) 



(4.3) 



log + ( i - 2 7 + 1) + log K 9l ^ +1 (2^/6^) (4.4) 

A' 9l _2 7 + 1 (2vW) 2 3 A ei _ 27+1 (2V^) 



with K v = -§^K V . 



Proof. To explict the Renyi information we need to calculate the integral appearing in 
dl.ll i. Hence, by means of the following integral representation for the Bessel function 



K v {xz) 



xp|-^(w + z 2 u v 1 du, v e 



and noting that K v (x) = K- V {x), we have for the invariant distribution (14.2b the 
following result 



r(x)dx 



2 a U 3 



»(fl!-2 T + l) 



A, 



: / a; Q(ei - 27) exp 


(y = 26 2 x) 

(8l-2 7 + l) 

2 X 



{-^{26 2 x + 2# 3 2T 1 )} dx 



^ A e -"_ 27+1 (2^g) 



90(61-27+1)+! 



x / J/ 
/o 



a(0i-2 7 ) 



cxp {-^(y + 48 2 6 3 y ^ dy 



1-2-1+ 



! (2V^ 



'03 
2 



2 «-x 

A ct (6l 1 -2 7 ) + l (20\/ 6> 2 3 ) 

A£_2 7 +i (2V^) 



»(Sl-2-y) + l 



A, 



a(0!-2 7 ) + 



1 (2aV^ 



Therefore we obtain the Renyi information ( 14.31 ) by simple calculations. In order to 
obtain the Shannon entropy we use the following quantity 



d 



doL^ da 



log A Q ( ei _2 7 )+i [2ay/6 2 6 3 ) - alog A ei _2 7+ i [2^/9^0, 



^A Q(ei _2 7) +i (2aV0Wz) 



K. 



a(6»i-2 7 )+ 



1 (2«V^ 



-logA ei _2 7+ i 2v^ 
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Since -^K v (x) = —K u -i(x) — vK <^ x ^ (see Gradshteyn and Ryzhik, 2007, for- 
mula 8.486(13)), it's easy to show that 

d 



i (2ay%9 : 



-{a{9 1 - 2 7 ) + l)X Q(ei _ 27)+ i (2a ■ 
Therefore putting all together, by de l'Hopital's rule, we have that 



1 



d 



Moa/ttI-i™^ 



= - log + (°i - 27 + 1) + logif ei _2 7+ i (2 VOzTs 



(0i - 27) 



27 + 1 



(2V^ 



V f 2(7377 /„ /7r-?r 



27+1 



□ 



The expression of the Song's measure can be obtained as well but it is too compli- 
cated and involves higher order derivatives of the Bessel's functions. 

Remark 4.1. According to Remark \2.1\ the Renyi information for the generalized in- 
verse Gaussian diffusions is a function with codomain 



\ogK 6l _ 2l+1 (2^6 



5 Hyperbolic diffusions 

Hyperbolic distributions have been extensively used in finance to model assets prices or 
log returns which deviates from the Gaussian law (see e.g. Eberlein and Keller, 1995 
and Boyarchenko and Levendoroskii, 2002). Here we consider hyperbolic diffusion 
processes in the sense that their invariant law is an hyperbolic distribution. The first 
simple version of hyperbolic process was introduced by Barndorff-Nielsen (1977) and 
further several generalizations and their applications in finance has been considered 
in Bibby and S0rensen (1997). The solution of the following stochastic differential 
equation 

dX t = J [3 - 7 — Xt \dt + adWt (5.1) 

is called hyperbolic diffusion (in the sense of Bibby and S0rensen, 1997) with invariant 
law 



f(x) = - Jf, , f fl2 , exp{- 7v /^ + {x At )2 + f3 {x _ xei 

(5.2) 

The next theorem represents the main result of this section. 
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Theorem 5.1. For the hyperbolic diffusions we have that 



n M ) = - log U ^- log r 1 ( ^^^ ) (5.3) 



anc/ 



^! (/) = log K x (S^f^p) - log I J + 1 (5.4) 



2 



s(f) =i+s'tf-n 



K (S^I^W) K-2 (5^^P) 



2Ki 



a 2 (s^i^W) \ 



2K 



2 (fiJjS—tf} 



Proof. We consider the integral 



(5.5) 



exp {— cry\/ S 2 + (x — /i) 2 + a/3(x — /i)}dx 

(5.6) 

By means of a change of parametrization <p = a(j + (3), i/j = a{p/ — /?), we obtain that 

f -f oo 

exp {— aryyj S 2 + (x — /.t) 2 + a(3(x — /i)}dx 



exp {— ajy/ S 2 + x 2 + a/3x}dx 



-oo 



exp 



-^[ip(y/S 2 + x 2 - x) +i/j(\ / 5 2 +x 2 + 



dx 



We note that the monotone transformation Sy = \/6 2 + x 2 + x maps R into (0, oo) 
with inverse function x = f (y — 1/y). Therefore 



+ OC 



exp 



2 

5 r i 



= 5 



> 



~[(p(V$ 2 + x 2 -x) + tp{\/S 2 + x 2 + x)] 
1 + \ ) exp \-i ( ^ + 0y ] idy 



2 Vy 



(5 / 



tp \/ t P'4> 

2<5 7 



2 V y 



+ U )>dy + ip / ?/ exp 



(5 / (/Ji/ 1 



2 V y 



V >dy 



K 1 (a5^~{ 2 - /? 2 ) 
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and we can write 



a V 2l5 ) ^?(<V7 2 -/3 2 ) ' 

At this point by means of the integral I a the formula (15.3b easily follows. To calculate 
the Shannon entropy we use de l'Hopital rule to explicit the following limit 

lim — — (logA'iMvV-/? 2 ) - "log KU 5 V 'i 1 -/3 2 )) . 
1 — a I J 

Hence by observing that 

9 



oa 

x cxp < — — ha; > da; 



we get 



(/) = - log y^/ j + 1^(6 v^W) 



log ( ^/ j +log^i(5V^^) 



where in the last step we have used the relationship 

K (z) + K 2 (z) _ K Q {z) 

Z 2K x {z) K x (z)' 

By the same calculations, one gets 



- log (k x (s^ff^P) ) + log (Ki (aS^fF^W) ) | 
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which permits us to write 

S(f) 



= lim { [a - l)<5yV - P 2 



K 2 (aS^f^P) 



-K, 



o (W7 2 - /3 2 ) ^ (a^v/T 1 ^ 



-if (a<V7 2 - P 2 ) faKx (a6y/>y* - ~f$ 



11 1 



a 2 a [ —2(1 — a) 



= 5 2 {! 2 -P 2 ) 



Remark 5.1. Since 



K 2 


[Sy/l 2 - P 2 } 


+ K 


(V7 2 - P\ 


)k 2 


(V7 2 - P 2 ) 


2Kl 


^7 2 - P 2 ) 





K v (x) ~ \j —e ■ 



and A'„(0) — oo, it's easy to see that 



□ 



lim K a (f) = - log ( , 02 ) +logA" 1 ( ( 5V7 2— ~p) 



and 



lim lZ a (f) = oo. 

a—>0 



6 Skew Student's t-diffusions 



There are several skewed generalization of the Student's t-distribution which are widely 
used in financial context (see Aas and Haff, 2007, for a review). We introduce here a 
diffusion process which has the invariant distribution function that follows a skewed 
Student's t distribution in the sense of Jones and Faddy (2003). We consider the pro- 
cess solution of the following stochastic differential equation 



2 j + + Xf 



with invariant law on the real line 



1+h 



f3+h 



B( 1 ,p)Vl + p2^- 



(6.2) 



where 7 and P are positive. We observe that when 7 = /3, f(x) corresponds to a 
Student's t-distribution with 27 degrees of freedom, whilst if 7 < P or 7 > j3 the 
density ( 16.2b is respectively positively or negatively skewed. 

Remark 6.1. To obtain the stochastic differential equation (16. U we have borrowed the 
technique described in Bibby and S0rensen (2003) for costructing diffusion processes 
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with a specific invariant distribution. Let diffusion coefficient <j{x) = a be a real 
constant, the drift coefficient 

K x ) = \ c^s/O 1 )' 

where f(x) is a density function, then ( 16. U is an ergodic diffusion process with invari- 
ant law proportional to f(x). 

Theorem 6.1. Under the conditions a(7 + |) — 4 > aw/ a(/3 + i) — \ > we 
obtain that 

KM) _ _J_ log f 4°- g (M7 + |)-io(^|)-|)^ 

ana" 

^ = - l0g (»)-(^3 W) -(^^ W 

+(/3 + 7+l)V>(/? + 7) (6.4) 

S(f)=(f3+^\ i,(p)+L+Vj ^( 7 )-(/3 + 7 + l) 2 V'(/3 + 7) (6.5) 
Proof. Since 



(y 



1+ ^yTWTx^J V ^ 1 + (3 + x 2 ) 



^j + (3 + x 2 

r-l 



= v/tT^ / (1 + y) a (T+^-' (1 - i/J^+s^-sdy 
= (2w = l + i/) 



= 2 «( 7+ + i)-2 r(a( 7 +!)-!) +!)-!) 

V7 ; r(a( 7 + /3 + l)-l) 

the Renyi information ( 16.3b immediately follows. Starting by formula ( 16.3b simple 
calculations permit us to derive the Shannon and Song measures d6.4l ), ( 16.5b . □ 

Remark 6.2. We «ofe f/iaf 

lim TZ a (f) = IogB(7, /?) + J log(7 + /3) - 2 log 2 
a«fl'lim Q _ t o^a(/) = °°- 
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7 Exponential families of diffusions 

Exponential families of diffusion processes have been introduced in S0rensen (2007) 
and are solutions to the following stochastic differential equation 

v 

dX t = J2/3MXt)dt + \a(X t )dW t , (7.1) 

i=l 

with A > and v > and b{ functions such that a unique weak solution exists. These 
models are not exponential families of stochastic processes in the sense of Kiichler and 
S0rensen (1997). By using the reparametrization 9{ = (3i/\ 2 and the functions 

T i ( X )=2[ X ^\ d y 



, ° 2 (y) 

for some xq m the state space of X, the scale measure has the following representation 

s(x,6) =exp|-^^T i (x)| 

and the speed measure is 

m(x,6) = a(xy 2 exp^Y^e.T^x)^ . 

If we denote by (f)(9) = J m(x, 9)dx the normalizing constant, the invariant distribu- 
tion of this class of models takes the canonical form of an exponential family, i.e. 

f{x) = exp jxjWz) -2\oga{x) - (f>(6)\ . 

These models are ergodic (and hence the invariant density f(x) exists) under proper 
conditions on the parameter 9i,i = 1, . . . ,p. In particular, it is need that 9 £ 9 H 0i, 
where 



6 = j<9 £ M p : £ m(x, 9)dx < ooj 



and 



9i = j(9 £ R p : J^s{x, 9)dx = J s(x, 9)dx = ooj . 
For a general exponential diffusion the Renyi information is equal to 

n a (/) = ^— | -a<j>(0) + log J -J— exp | a £ Oft (x) jdxj . (7.2) 

Remark 7.1. Although it is not possible to obtain explicitly 7Z a , IZi and S in the gen- 
eral case, it is not hard to see that exponential families of diffusions include, as partic- 
ular cases, the Cox-Ingersoll-Ross, the Generalized Inverse Gaussian, the hyperbolic 
and the Ornstein-Uhlenbeck diffusions (see e.g. S0rensen, 2007). 
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Conclusions 



In this paper we have been able to obtain explicit forms of 7Z a , IZi and S for several 
classes of diffusion processes widely used in many fields including finance. These re- 
sults, may be useful as a reference to develop new diagnostic tools and estimation pro- 
cedures. The family of exponential diffusion processes, introduced in the last section, 
includes most of the other models for which we obtained explicit results as particular 
cases, so this family may be used as a building block to define goodness of fit tests for 
embedded families of diffusion processes based on the Renyi divergences. This will be 
the topic of further investigations. 
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